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Abstract — We consider the design of optimal localized feedback 
gains for one-dimensional formations in which vehicles only 
use information from their immediate neighbors. The control 
objective is to enhance coherence of the formation by making 
it behave like a rigid lattice. For the single-integrator model 
with symmetric gains, we establish convexity, implying that the 
globally optimal controller can be computed efficiently. We also 
identify a class of convex problems for double-integrators by 
restricting the controller to symmetric position and uniform 
diagonal velocity gains. To obtain the optimal non-symmetric 
gains for both the single- and the double-integrator models, we 
solve a parameterized family of optimal control problems ranging 
from an easily solvable problem to the problem of interest as the 
underlying parameter increases. When this parameter is kept 
small, we employ perturbation analysis to decouple the matrix 
equations that result from the optimality conditions, thereby 
rendering the unique optimal feedback gain. This solution is 
used to initialize a homotopy-based Newton's method to find 
the optimal localized gain. To investigate the performance of 
localized controllers, we examine how the coherence of large- 
scale stochastically forced formations scales with the number 
of vehicles. We establish several explicit scaling relationships 
and show that the best performance is achieved by a localized 
controller that is both non-symmetric and spatially-varying. 

Index Terms — Convex optimization, formation coherence, ho- 
motopy, Newton's method, optimal localized control, pertur- 
bation analysis, structured sparse feedback gains, vehicular 
formations. 



I. Introduction 

A. Background 

The control of vehicular platoons has attracted considerable 
attention since the mid sixties |l|-|[3|. Recent technological 
advances in developing vehicles with communication and 
computation capabilities have spurred renewed interest in this 
area p]|-|T2|. The simplest control objective for the one- 
dimensional (ID) formation shown in Fig. [T] is to maintain 
a desired cruising velocity and to keep a pre- specified con- 
stant distance between neighboring vehicles. This problem 
is emblematic of a wide range of technologically relevant 
applications including the control of automated highways, 
unmanned aerial vehicles, swarms of robotic agents, and 
satellite constellations. 

Recent work in this area has focused on fundamental 
performance limitations of both centralized and decentralized 
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Fig. 1: One-dimensional formation of vehicles. 



controllers for large-scale formations |[5|, |[7|, |pl-|T2l. For 
centralized linear quadratic optimal control formulations based 
on penalizing relative position errors it was shown in |[7| 
that stabilizability and detectability deteriorate as formation 
size increases. In |9|, it was shown that merge and split 
maneuvers can exhibit poor convergence rates even upon 
inclusion of absolute position errors in cost functionals. In jSj, 
it was shown that sensitivity of spacing errors to disturbances 
increases with the number of vehicles for formations with 
localized symmetric controllers that utilize relative position 
errors between neighboring vehicles. In ||TT|, the analysis 
of (5) was expanded to include heterogeneous vehicles, non- 
zero time headway, and limited communication range within 
the formation. 

The motivation for the current study comes from two recent 
papers, 1 12] and (TOl. In |T2|, fundamental performance limi- 
tations of localized symmetric feedback for spatially invariant 
consensus and formation problems were examined. It was 
shown that, in ID, it is impossible to have coherent large 
formations that behave like rigid lattice. This was done by 
exhibiting linear scaling, with the number of vehicles, of the 
formation-size-normalized I-L2 norm from disturbances to an 
appropriately defined macroscopic performance measure. In 
2D this measure increases logarithmically, and in 3D it remains 
bounded irrespective of the system size. These scalings were 
derived by imposing uniform bounds on control energy at each 
vehicle. 

For formations on a one-dimensional lattice, it was shown 
in pO| that the decay rate (with the number of vehicles) 
of the least damped mode of the closed-loop system can be 
improved by introducing a small amount of 'mistuning' to the 
spatially uniform symmetric feedback gains. A large formation 
was modeled as a diffusive PDF, and an optimal small-in- 
norm perturbation profile that destroys the spatial symmetry 
and renders the system more stable was designed. Numerical 
computations were also used to demonstrate that the spatially- 
varying feedback gains have beneficial influence on the closed- 
loop T-Loo norm. The PDF approaches have also been found 
useful in the deployment of multi-agents jTSj, |T4| and in 
coordination algorithms fTS] . 

Fven though traditional optimal control does not facilitate 
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TABLE I: Summary of asymptotic scalings with the number of vehicles N for the optimal symmetric and non-symmetric 
position gains. The A/'-independent control penalty, R = rol, in the quadratic performance objective leads to similar growth 
with of formation coherence and control energy (per vehicle). On the other hand, the A^-dependent control penalty that 
provides bounded control energy yields less favorable coherence. 
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incorporation of structural constraints and leads to central- 
ized architectures, the optimal feedback gain matrix for both 
spatially invariant systems |T6| and systems on graphs fTTj 
have off-diagonal decay. Several recent efforts have focused 
on identification of classes of convex distributed control prob- 
lems. For spatially invariant controllers in which information 
propagates at least as fast as in the plant, convexity was 
established in fT8| , |T9J . Similar algebraic characterization 
for a broader class of systems was introduced in | [20| , and 
convexity was shown for problems with quadratically in- 
variant constraint sets. Since these problems are convex in 
the impulse response parameters they are in general infinite 
dimensional. In [21 1, a state-space description of systems 
in which information propagates at most one unit in space 
for every unit in time was provided and relaxations were 
used to obtain suboptimal controllers. In I^Z], the optimal 
control problem for switched autonomous systems was studied 
and optimality conditions for decentralization of multi-agent 
motions were derived. In f23 1, convexity of the symmetric edge 
weight design for minimization of the mean-square deviation 
in distributed average consensus was shown. 

While references fT8l-f2T| focus on the design of optimal 
dynamic distributed controllers, we develop tools for the 
design of optimal static feedback gains with pre-specified 
structure. Even though the framework of fT8l-f2r| does not 
apply to our setup, we identify a class of convex problems 
which can be cast as a semi-definite program (SDP). Further- 
more, we show that the necessary conditions for optimality are 
given by coupled matrix equations, which can be solved by 
a combination of perturbation analysis and homotopy-based 
Newton's method. We consider the design of both symmetric 
and non-symmetric feedback gains and show that departure 
from optimal symmetric design can significantly improve the 
coherence of large-scale formations. 

B. Preview of key results 

We consider the design of optimal localized feedback gains 
for one-dimensional formations in which each vehicle only 
uses relative distances from its immediate neighbors and 
its own velocity. This nearest neighbor interaction imposes 
structural constraints on the feedback gains. We formulate the 
structured optimal control problem for both the single- and 
the double-integrator models. For single-integrators, we show 



that the structured optimal control problem is convex when we 
restrict the feedback gain to be a symmetric positive definite 
matrix. In this case, the global minimizer can be computed 
efficiently, and even analytical expressions can be derived. For 
double-integrators, we also identify a class of convex problems 
by restricting the controller to symmetric position and uniform 
diagonal velocity gains. 

We then remove this symmetric restriction for both the 
single- and the double-integrator models and begin the design 
process with a spatially uniform controller. We develop a 
homotopy-based Newton's method that traces a continuous 
solution path from this controller to the optimal localized gain. 
Along this homotopy path, we solve a parameterized family 
of the structured optimal control problems and obtain ana- 
lytical solutions when the homotopy parameter is small. We 
employ perturbation analysis to decouple the matrix equations 
that result from optimality conditions, thereby rendering the 
unique optimal structured gain. This solution is used to warm- 
start Newton's method in order to efficiently compute the 
desired optimal gains as the homotopy parameter is gradually 
increased. 

In the second part of the paper, we examine how the 
performance of the optimally-controlled formation scales with 
the number of vehicles. We consider both macroscopic and 
microscopic performance measures based on whether attention 
is paid to the absolute position error of each vehicle or 
the relative position error between neighboring vehicles. We 
note that the macroscopic performance measure quantifies 
the resemblance of the formation to a rigid lattice, i.e., it 
determines the coherence of the formation. As shown in |[T2|, 
even when local positions are well-regulated, an 'accordion- 
like motion' of the formation can arise from poor scaling of the 
macroscopic performance measure (formation coherence) with 
the number of vehicles A^. Our objective is thus to enhance 
formation coherence by means of optimal localized feedback 
design. In situations for which the control penalty in the 
quadratic performance objective is formation- size-independent 
we show that the optimal symmetric and non- symmetric 
controllers asymptotically provide 0{-\fN) and 0{\fN) scal- 
ings of formation coherence. However, this introduces similar 
growth of the control energy (per vehicle) with A^. We show 
that bounded control energy can be obtained by judicious 
selection of an A^-dependent control penalty, leading to O(A^) 
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and O^s/N) scalings of formation coherence for the optimal 
symmetric and non- symmetric controllers, respectively. These 
results are summarized in Table |T| and they hold for both single- 
and double-integrators for formations in which each vehicle 
has access to its own velocity, see Sections |V] and |Vl| for 
additional details. 

In addition to designing optimal localized controllers, we 
also provide an example of a spatially uniform non- symmetric 
controller that yields better scaling trends than the optimal 
spatially varying controller obtained by restricting design to 
symmetric gains. This indicates that departure from symmetry 
can improve coherence of large-scale formations and that the 
controller structure may play a more important role than the 
optimal selection of the feedback gains. On the other hand, 
our results also show that the optimal localized controller 
that achieves the best performance is both non-symmetric and 
spatially -varying. 

If each vehicle has access to its own velocity and to 
relative distances from its nearest neighbors, we show sim- 
ilarity between the optimal position gains and performance 
scaling trends for single- and double-integrators. The latter 
observation is in agreement with analytical results obtained for 
spatially invariant formations |12|. We note that performance 
of controllers that rely on relative measurements or unidi- 
rectional position exchange can differ significantly for these 
two models. For spatially-invariant formations with relative 
position and velocity measurements, it was shown in 1 12] that 
the global performance scales as 0{N^) for double-integrators 
and as 0{N) for single-integrators. In Section V-B[ we show 
that spatially uniform look-ahead strategy provides O^s/N) 
scaling of the global performance for the single-integrator 
model. On the other hand, a look-ahead strategy that is not 
carefully designed can introduce unfavorable propagation of 
disturbances through formation of double-integrators jSj, |[5|. 

The paper is organized as follows. We formulate the struc- 
tured optimal control problem in Section |ll| and show con- 
vexity of the symmetric gain design for the single-integrator 



model in Section III For non- symmetric gains, we develop the 



homotopy-based Newton's method in Section IV We examine 
performance of localized controllers for the single- and the 
double-integrator models in Sections [V| and |Vlj respectively, 
where we provide several explicit scaling relations. We con- 
clude the paper in Section |VII| with a brief summary of our 
contributions. 

II. Problem formulation 

A system of TV identical vehicles moving along a straight 
line is shown in Fig. [T] All vehicles are equipped with ranging 
devices that allow them to measure relative distances with 
respect to their immediate neighbors. The objective is to design 
an optimal controller that uses only local information (i.e., 
relative distances between the neighboring vehicles) to keep 
each vehicle at its global position on a grid of regularly spaced 
points moving with a constant velocity. 

We consider both the single- and the double-integrator 
models of the vehicles. The double-integrators are employed in 
many studies of vehicular formations; for example, see ||TJ-||3|, 



ig, 0, l|9|, l[TO|, (ig, l|24|. On the other hand, the single- 
integrator (i.e., kinematic) model is simpler and perhaps more 
revealing in understanding the role of network topologies |[4|, 
| [23| , |[25j-||28j. As we show in Section [Vl| the single- and 
the double-integrator models exhibit similar performance for 
formations in which each vehicle - in addition to relative 
positions with respect to its immediate neighbors - has an 
access to its own velocity. In the remainder of this section, 
we formulate the localized optimal control problem for both 
single- and double-integrators. 



A. Single- and double -integrator models 

We first consider the kinematic model in which control input 
Un directly affects the velocity. 



Pn 



e {l,...,A^}, 



where pn is the position of the nth vehicle and dn is the 
disturbance. The desired position of the nth vehicle is given 

Pd,n = -\- nS^ where Vd is the desired cruising velocity 
and S is the desired distance between the neighboring vehicles. 
Every vehicle is assumed to have access to both Vd and S. In 
addition, we confine our attention to formations with a known 
number of vehicles and leave issue of adaptation, merging, 
and splitting for future study. 

The localized controller utilizes relative position errors 
between nearest neighbors, 

Un = - fniPn " Pn-1 - ^) - K{Pn " Pn+1 + + ^d, 

where the design parameters fn and hn denote the forward 
and backward feedback gains of the nth vehicle. In deviation 
variables, {pn '•= Pn - Pd,n, := Un - Vd, dn := dn}, the 
single-integrator model with nearest neighbor interactions is 
given by 

Pn = dn ^ Un, (la) 
Un = - fn {Pn " Pn-l) " K {Pn - Pn+l) , (lb) 



where the relative position errors 
can be obtained by ranging devices. 



Pn-i and Pn - Pn+l 



As illustrated in Fig. 2a fictitious lead and follow vehicles, 
respectively indexed by and + 1, are added to the 
formation. These two vehicles are assumed to move along 
their desired trajectories, implying that po = Pn-\-i = 0, and 
they are not considered to belong to the formation. Hence, the 
controls for the 1st and the A^th vehicles are given by 

ui = - fiPi - hi {pi - P2) , 

UN - fnipN - Pn-i) - ^nPn- 

In other words, the first and the last vehicles have access to 
their own global position errors pi and pn, which can be 
obtained by equipping them with GPS devices. 
For the double-integrator model. 



Pn 



dn Un, n e {1, . . .,N}, 



we consider the controller that has an access to the relative 
position errors between the neighboring vehicles and the 
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error with respect to the {N — l)th vehicle, i.e., = 
implying that un = — /at (pat — Pn-i) for the single- 
integrator model and un = — /at {pn — Pn-i) — Qn^n for 
the double-integrator model. 
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Fig. 2: Formation of vehicles with localized (a) non- 
symmetric; and (b) symmetric gains. 



absolute velocity errors, 

Un = - fn {Pn - Pn-1 - S) - {pn - Pn+1 + 5) 
-9n (pn - Vd), 

where Qn denotes the velocity feedback gain. In deviation 
variables, {pn := Pn - Pd,n. Vn -= Pn - ^d, Un '= Un, 
dn '= dn}j the double-integrator model is given by 

Pn = dn ^ Un, (2a) 
Un = - fn {Pn - Pn-l) - K {Pn - Pn+l) - 9n Un- 

(2b) 



B. Structured I-L2 problem 

The state- space representation of the vehicular formation is 
given by 

X = Ax -\- Bid -\- B2U, 
y = C x^ u = — F y. 

For the single-integrator model ([T]), the state vector is x = p, 
the measured output y is given by the relative position errors 
between the neighboring vehicles, and 



A 
F 



O, Bi = 
[ Ff F, 



I, c 



(VPl) 



For the double-integrator model ([2](, the state vector is a; = 



[p^ V 



T IT 



] , the measured output y is given by the relative 
position errors between the neighboring vehicles and the 
absolute velocity errors, and 



C 



In matrix form, control laws i fTbl i and (|2b]i can be written 



O I 
O O 
Cf o 
CJ o 
O I 



Bi = B2 



O 
I 



F = [Fj Fb F„ ] 



(VP2) 



as. 



FCp = - [Ff Fb] 
FC 



r-,T 



Here, O and I denote the zero and identity matrices, and {Ff, 
Fb, Fy, Cf} are defined in 
Upon closing the loop, we have 

X = {A - B2FC)x + Bid, 



[ Ff Fb F, ] 



Cf O 
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O I 
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where p, v, and u denote the position error, the veloci^ error, 
and the control input vectors, e.g., p = [pi ■ ■ ■ Pn] • Fur- 
thermore, the N X N diagonal feedback gains are determined 
by 

Ff := diag{/„}, Fb := diag{6„}, F„ := diag{5i„}, 

and C/ is a sparse Toeplitz matrix with 1 on the main diagonal 
and — 1 on the first lower sub-diagonal. For example, for N = 
4, 
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where z encompasses the penalty on both the state and the 
control. Here, Q is a symmetric positive semi-definite matrix 
and r is a positive scalar. The objective is to design the 
structured feedback gain F such that the influence of the white 
stochastic disturbance d, with zero mean and unit variance, on 
the performance output z is minimized (in the I-L2 sense). This 
control problem can be formulated as | [29| , jSOj 

minimize J = trace (^PBiBf^ 

subject to {A - B2FCYP + P{A - B2FC) = 

- (Q + rC^F^FC), F eS 

(SH2) 

where S denotes the structural subspace that F belongs to. 
As shown in |29|, the necessary conditions for optimality 



(3) 

Thus, Cfp determines the vector of the relative position errors 
Pn — Pn-1 between each vehicle and the one in front of it; 
similarly, Cj p determines the vector of the relative position 
errors Pn — Pn+i between each vehicle and the one behind it. 

We will also consider formations with no fictitious follow- 
ers. In this case, the TVth vehicle only uses relative position 



of (SH2) are given by the set of coupled matrix equations in 
F, P, and L 

{A - B2FCY P ^ P{A - B2FC) = 

- (Q + rC^F^FC) , (NCI) 
L{A - B2FCf = -BiBl, (NC2) 

(NC3) 



{A - B2FC) L 
(rFCLC^) o Is 



{B^PLC^)oIs. 
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Here, P and L are the closed-loop observability and control- 
lability Gramians, o denotes the entry- wise multiplication of 
two matrices, and the matrix Is in |(NC3)| denotes the structural 
identity of the subspace S under the entry- wise multiplication, 
i.e., F o Is = F, with 1^ = [I /] for the single-integrator 
model and Is = [I I /] for the double-integrator model. 
(For example, [Ff F5] o [/ I] = [Ff In the absence 

of the fictitious follower, an additional constraint = 



is imposed in (SH2) and thus, the structural identity for the 
single- and the double-integrator models are given by [ / Iz] 
and [ / Iz I], respectively. Here, Iz is a diagonal matrix with 
its main diagonal given by [ 1 • • • 1 ] . 

Remark 1: Throughout the paper, the structured optimal 



feedback gain F is obtained by solving |(SH2)| with Q = I. 
This choice of Q is motivated by our desire to enhance 
formation coherence, i.e., to keep the global position and 
velocity errors Pn and small using localized feedback. Since 
the methods developed in the paper can be applied to other 
choices of Q, we will describe them for general Q and set 
Q = I when presenting computational results. 

C. Performance of optimal localized controller 

To evaluate the performance of the optimal localized con- 
troller F, obtained by solving (SH2)| with Q = /, we consider 
the closed-loop system 

X = {A - B2FC) X + Eld, 

(4) 



c = 



" Ci " 




\ Ql" 1 


. C2 . 




.-PC . 



X, s = g ov s 



= I 



where Ci is the global or local performance output and C2 is 
the control input. Motivated by |12|, we examine two state 
performance weights for the single-integrator model 

• Macroscopic (global): Qg = /; 

• Microscopic (local): Qi = P, 

where P is mi N x N symmetric Toeplitz matrix with its 
first row given by [ 2 
N = 4, 



1 • • • 0] G R^. For example, for 



T = 



(5) 



The macroscopic performance weight Qg = I penalizes the 
global (absolute) position errors, 

N 

CfCl =P^QgP = J2Pn^ 



n = l 



and the microscopic performance weight Qi = P penalizes 
the local (relative) position errors, 

N 

CiCl = P^QlP = X](Pn-Pn+l)^ 



n = 



with po = pn-\-i = 0. These state weights induce the 
macroscopic and microscopic performance measures |T2| de- 
termined by the formation-size-normalized I-L2 norm 

n,(iV) = {l/N)\\G4l s = g or s = l, (H) 



where Gi is the transfer function of ^ from d to (i. The 
macroscopic performance measure 11^ quantifies the resem- 
blance of the formation to a rigid lattice, i.e., it determines 
the coherence of the formation ||T2|. On the other hand, 
the microscopic performance measure Hi quantifies how well 
regulated the distances between the neighboring vehicles are. 
We will also examine the formation- size-normalized control 
energy (variance) of the closed-loop system (|4]), 



nctr(iv) = (i/Ar)||G2|| 



which is determined by the I-L2 norm of the transfer function 
G2 from d to (2 = u. 

Similarly, for the double-integrator model, we use the fol- 
lowing performance weights 

• Macroscopic (global), Qg = ^ ^ 



Microscopic (local), Qi = 



O I 

P O 
O I 



D. Closed-loop stability: the role of fictitious vehicles 

We next show that at least one fictitious vehicle is needed 
in order to achieve closed-loop stability. This is because the 
absence of GPS devices in the formation prevents vehicles 
from tracking their absolute desired trajectories. 

For the single-integrator model, the state-feedback gain 
Kp = Ff Cf -\- Fi) Cj is a structured tridiagonal matrix 

satisfying Kpl = [fi ••• bj^]^ where 1 is the vector 
of all I's. If neither the 1st nor the Nth vehicle has access 
to its own global position, i.e., /i = ^at = 0, then Kp has 
a zero eigenvalue with corresponding eigenvector 1. Hence, 
the closed-loop system is not asymptotically stable regardless 
of the choice of the feedback gains {fn}n = 2 {^n}^=i- 
In the presence of stochastic disturbances, the average-mode 
(associated with the eigenvector 1) undergoes a random walk 
and the steady- state variance of the deviation from the absolute 
desired trajectory becomes unbounded 1 12|, | [23| , | [28| . In this 
case, other performance measures that render this average- 
mode unobservable can be considered \T2]. 

For the double-integrator model, the action of Ad = A — 
B2FC on [1^ 0^]^ is given by 



O 



I 

-F, 





1 














-Kpl 



where is the A/'-vector of all O's. Thus, if /i = bN = 
then Ac\ has a zero eigenvalue with corresponding eigenvector 
[1^ 0^]^. Therefore, for both the single- and the double- 
integrator models, we need at least one vehicle with access to 
its global position in order to achieve closed-loop stability. 

III. Design of symmetric gains for the 

SINGLE-INTEGRATOR MODEL: A CONVEX PROBLEM 
In this section, we design the optimal symmetric feedback 



gains for the single-integrator model; see Fig. [2b] This is a 
special case of the localized design, obtained by restricting 
the forward and the backward gains between the neighboring 
vehicles to be equal to each other, i.e., fn = bn-i for 
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n e {2,...,A^}. Under this assumption, we show that (SH2) is 
a convex optimization problem for the single-integrator model. 
This implies that the global minimum can be computed effi- 
ciently. Furthermore, in the absence of the fictitious follower, 
we provide analytical expressions for the optimal feedback 
gains. 



Let us denote ki = /i and /cat+i = bjy and let 
kn = fn = n G {2, . . . , TV}. 



(6) 



For the single-integrator model, the structured gain becomes 
a symmetric tridiagonal matrix 

ki + k2 



K 



-k2 
k2 + ks 



(7) 



-/cat 

-kjy kN + kjy^i 

Consequently, = —K is Hurwitz if and only if K 
is positive definite, in which case the Lyapunov equation 
in 



(SH2)] simplifies to 

KP - 



PK = Q ^ rKK. 



rK) 



The application of jJT] Lemma 1] transforms the prob- 
lem |(SH2)| of optimal symmetric design for the single- 
integrator model to 

minimize J{K) = (1/2) trace (Qi^"^ 

subject to K > and K G Sk 

where K e Sk is a linear structural constraint given by 
(Specifically, K = FfCf -\- FhCj is a symmetric tridiag- 
onal matrix with the linear constraint ([6]).) By introducing 



(SG) 



an auxiliary variable X = > Q^^'^K 
formulate |(SG)1 as an SDP in X and K 

minimize (1/2) trace (X + rK) 

X,K 

subject to K > 0, K e Sr, 



K 



)l/2 



X 



we can 



>0, 



which can be solved using available SDP solvers. Here, we 
have used the Schur complement |[32| Appendix A.5.5] in 
conjunction with > to express X > Q^I^K~^Q^I^ as an 
LML 



Next, we exploit the structure of K to express J in (SG) 



with Q = / in terms of the feedback gains {/Cnj^^i between 
the neighboring vehicles. Since the inverse of the symmetric 
tridiagonal matrix K can be determined analytically [33^ 
Theorem 2.3], the ijth entry of is given by 



'AT+l 



■7,) 



3 > h 7i 



yielding the following expression for J 

J = (1/2) trace (i^-^ + rK) 



(8) 



1 ^ 



In) 



+ r 



N 



n = 2 



The above expression for J is well-defined for {/Cnj^Ti that 
guarantee positive definiteness of in ([7|; this is because the 
closed-loop A-matrix is determined by A^i = —K. The global 
minimizer of J can be computed using the gradient method; 
see Appendix |A| 

For the formations without the fictitious follower, we next 
derive explicit analytical exp ression for the global symmetric 
minimizer K = K^ > of (SG) with Q = /. In this case 
^AT+i = and the ijth entry of K~^ in ^ simplifies to 
{K~^)ij = 7i for j > i. Consequently, the unique minimum 
of 



J 



n=l \ n=2 / 



1 ^ 



ki 



N 



E 



is attained for 



ki = ^nJ^, kn = V(^ + l-n)/(2r), n G {2, . . . , AT}. 

(9) 

We also note that 

N 



trace {K'^) 



N 

E^- 

n = l 



E 



A/' + l 



kn 



ki 



N \ 
n = 2 / 



'trace (K), 



(10) 

where the third equality follows from ([9]). This result is 
used to examine the performance of large-scale formations 
in Section IV-CI 

Figure [3] shows the optimal symmetric gains for a formation 
with A^ = 50 vehicles, Q = I, and r = 1. Since the fictitious 
leader and the follower always move along their desired 
trajectories, the vehicles that are close to them have larger 
gains than the other vehicles. When no fictitious follower is 
present, the gains decrease monotonically from the first to the 
last vehicle; see (x) in Fig. [3] In other words, the farther 
away the vehicle is from the fictitious leader the less weight 
it places on the information coming from its neighbors. This 
is because uncorrected disturbances that act on the vehicles 
corrupt the information about the absolute desired trajectory as 
it propagates from the fictitious leader down the formation (via 
relative information exchange between the vehicles). When 
both the fictitious leader and the follower are present, the gains 
decrease as one moves from the boundary to the center of 
the formation; see (o) in Fig. |3] This can be attributed to the 
fact that the information about the absolute desired trajectories 
becomes noisier as it propagates from the fictitious vehicles 
to the center of the formation. 

IV. HoMOTOPY-BASED Newton's METHOD 

In this section, we remove the symmetric feedback gain 
restriction and utilize a homotopy-based Newton's method 
to solve |(SH2)| In p9|, Newton's method for general struc- 



tured I-L2 problems is developed. For |(SH2)| with the specific 
problem data |(VP1)| and |(VP2)[ it is possible to employ a 
homotopy-based approach to solve a parameterized family of 
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Fig. 3: Optimal symmetric gains for formations with follower 
(o) and without follower (x) for = 50, Q = and 
r = 1. (x) are obtained by evaluating formula (|9| and (o) are 
computed using the gradient method described in Appendix [A[ 



R Pq where Pq is the positive definite solution of 



A' Po + PoA + Qo - PoB2R-^B^Po 



0. 



For the kinematic model |(VP1)[ A = O and B2 = /, with 
R = rl, we have Kq = r'^Po and Qo - t-^PqPq = 0. 
Therefore, the state penalty Qo = tKq = rT^ guarantees 
inverse optimality of the spatially uniform symmetric gain Kq . 
The above procedure of finding Qo can be applied to any 
structured gain Fq that yields a symmetric positive definite 
Kq, e.g., the optimal synmietric gain of Section 



B. Perturbation analysis for e <C 1 



We next utilize perturbation analysis to solve (SH2) with 



Q{e) given by ( 11 ) for £ <C 1. For small £, by representing 
P, L, and F as 



problems, which ranges between an easily solvable problem 
and the problem of interest. 
In particular, we consider 



Q{e) = Qo + ^(Qd 



(11) 



where Qo is the initial weight to be selected, Qd is the 
desired weight, and £ G [0, 1] is the homotopy parameter. 
Note that Q = Qo for e = 0, and Q = Q^^ for £ = 1. 
The homotopy-based Newton's method consists of three steps: 
(i) For £ = 0, we find the initial weight Qo with respect to 
which a spatially uniform gain Fq is inversely optimal. This 



is equivalent to solving problem |(SH2)| analytically with the 
performance weight Qo. (ii) For < 6 ^ 1, we employ 
perturbation analysis to determine the first few terms in the 
expansion F{e) = Yl^^Q^^^n- (iii) For larger values of 
we use Newton's method for structured I-L2 design f29l to 



solve |(SH2)[ We gradually increase e and use the structured 
optimal gain obtained for the previous value of £ to initialize 
the next round of iterations. This process is repeated until the 
desired value e = 1 is reached. 

In the remainder of this section, we focus on the single- 



integrator model. In Section VI we solve problem (SH2) for 
the double-integrator model. 

A. Spatially uniform symmetric gain: inverse optimality for 

6 = 

One of the simplest localized strategies is to use spatially 
uniform gain, where Ff and F5 are diagonal matrices with 
fn = f and bn = b for all n and some positive / and b. In 
particular, for Ff = Fjj = I it is easy to show closed-loop 
stability and to find the performance weight Qo with respect 
to which the spatially uniform symmetric gain 



Ko = FoC = [I I] 



= T 



is inversely optimal. The problem of inverse optimality 
amounts to finding the performance weight Qo for which 
an a priori specified Kq is the corresponding optimal state- 
feedback gain p4), p5|. From linear quadratic regulator 
theory, the optimal state-feedback gain is given by Kq = 



n=0 n=0 n=0 

substituting in |(NC1)||(NC3)[ and collecting same-order terms 
in e, we obtain the set of equations (PA) with Aq := A — 
B2F0C. Note that these equations are conveniently coupled in 
one direction, in the sense that for any n > 1, 0{e'^) equations 
depend only on the solutions of 0{e'^) equations for m < n. 
In particular, it is easy to verify that the first and the third 
equations of 0(1) are satisfied with Kq = FqC = r~^PjPo 
and with Qo = vKq identified in Section IV- A Thus, the 
matrix Lq can be obtained by solving the second equation 
of 0(1), and the matrices Pi, Pi, and Pi can be obtained 
by solving the first, the third, and the second equations of 
0(e), respectively. The higher order terms P^, Pn, and P^ 
can be determined in a similar fashion. The matrix P found 
by this procedure is the unique optimal solution of the control 
problem [(SH2)] for £ <C 1. This is because the equations |(PA)| 
under the assumption of convergence for small e, give a unique 
matrix P(6) = ^^=0 ^"^n- 

We next provide analytical expressions for Pi 



(PA) 



[Pj^^ F^^^ ] obtained by solving the 0{e) equations in 
with r = 1, Qo = P^, and Qd = I. When a fictitious follower 
is present, we have (derivations are omitted for brevity) 



Jn 
Un 



n{n-N- l)(4n(7V + 1) - N{2N + 7) + 1) 
' 12 {N^ - 1) 

n{N + 1 - n){4n{N + 1) - N{2N + 1) - 5) 
12 - 1) 



1 

"2' 
1 

" 2' 
(12) 



where fn"^ and 6n ^ denote the nth diagonal entries of F^ 

and F^^\ From ^ it follows that /^^^ = b^N-^i-n ^ ^ 
{1, . . . , A^}. When a fictitious follower is not present, we have 



Jn 

Jn 

"at 



= {N- 
= (n2 
= 0. 



2 + {N+l)n 
l)/2, 

- Nn - l)/2, 



l)/2, nG{l, 
n G {1, 



,iv-i}, 



To compute the optimal structured feedback gain for larger 
values of e, we use F{s) obtained from perturbation analysis 
to initialize Newton's method, as described in Section |IV-C| 
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0(1) 



0{s) 



0{e^) : 



A^Po + Po^o 
AoLo + LoA^ 
{rFoCLoC^) o Is 

A^Pi + PiAo : 
AoLi + LiA^ : 
{rFiCLoC^)oIs : 

Ag^P2 + P2A0 
A0L2 + ^2^5^ 
{rF^CLoC^) o /5 



= -(Qo + rC^F^FoC) 
= -Pi^f 

= -{Qd-Qo) 

= {B2FiC)Lo + Lo{B2FiC)^ 

= {B2FiCfPi + Pi{B2FiC) 
= {B2FiC)Li + Li{B2FiC)^ 
= {BjPiLrC^ + BjP2LoC^ 



rC^F^FiC 
{B2F2C)Lo 



(PA) 



Lo{B2F2Cy 



rFiCLiC^)oIs 



C. Newton method for larger values of e 

In this section, we employ Newton's method developed 
in f29 | to solve the necessary conditions for optimality|(NCl) 



(NC3) as e is gradually increased to 1. Newton's method 
is an iterative descent algorithm for finding local minima 
in optimization problems |32|. Specifically, given an initial 
stabilizing structured gain a decreasing sequence of the 
objective function { J(F*)} is generated by updating F accord- 
ing to = + 5* F*. Here, is the Newton direction 
that satisfies the structural constraint and 5* is the step-size. 
The details of computing F* and choosing the step-size 5* can 
be found in \^9\. 

For small s, we initialize Newton's method using Fi^e) 
obtained from the perturbation expansion up to the first order 
in £, F{e) = Fq + sFi. We then increase e slightly and use 
the optimal structured gain resulting from Newton's method 
at the previous e to initialize the next round of iterations. We 
continue increasing e gradually until desired value £ = 1 is 
reached, that is, until the optimal structured gain F for the 
desired is obtained. 

Since the homotopy-based Newton's method solves a family 
of optimization problems parameterized by e, the optimal 
feedback gain is a function ofe G [0, 1]. To see the incremental 
change relative to the spatially uniform gain Fq, we consider 
the difference between the optimal forward gain fn{£) and the 
uniform gain /n(0) = 1, 

fu{e) := fn{e) - /„(0) = /„(e) - 1. 



Figure 4a shows the normalized profile f{€)/\\f{€)\\ for 
a formation with fictitious follower, N = 50, r = 1, 
Qo = T^, and Qd = I. The values of e are determined 
by 20 logarithmically spaced points between 10~^ and 1. As 
£ increases, the normalized profile changes from an almost 
sinusoidal shape (cf. analytical expression in ( 12)) at e = 10~^ 
to an almost piecewise linear shape at e = 1. Note that 
the homotopy-based Newton's method converges to the same 
feedback gains at £ = 1 when it is initialized by the optimal 



symmetric controller obtained in Section III 



ward and backward gains satisfy a central symmetry property, 

fn = ^AT+l-n, n G {1,...,A/'}, 



for all e e [0, 1]; see Fig. 4b for £ = 1. We note that the first 
vehicle has a larger forward gain than other vehicles; this is 
because it neighbors the fictitious leader. The forward gains 
decrease as one moves away from the fictitious leader; this 
is because information about the absolute desired trajectory 
of the fictitious leader becomes less accurate as it propagates 
down the formation. Similar interpretation can be given to the 
optimal backward gains, which monotonically increase as one 
moves towards the fictitious follower. 

Since the 1st vehicle has a negative backward gain (see 



Fig.|4b]), if the distance between the 1st and the 2nd vehicles is 
greater than the desired value S, then the 1st vehicle distances 
itself even further from the 2nd vehicle. On the other hand, 
if the distance is less than S, then the 1st vehicle pulls itself 
even closer to the 2nd vehicle. This negative backward gain 
of the 1st vehicle can be interpreted as follows: Since the 1st 
vehicle has access to its global position, it aims to correct 
the absolute positions of other vehicles in order to enhance 
formation coherence. If the 2nd vehicle is too close to the 1st 
vehicle, then the 1st vehicle moves towards the 2nd vehicle to 
push it back; this in turn pushes other vehicles back. If the 2nd 
vehicles is too far from the 1st vehicle, then the 1st vehicle 
moves away from the 2nd vehicle to pull it forward; this in 
turn pulls other vehicles forward. Similar interpretation can 
be given to the negative forward gain of the Nth vehicle that 
neighbors the fictitious follower. Also note that the forward 
gain of the A^th vehicle becomes positive when the fictitious 



follower is removed from the formation; see Fig. 5c This 
perhaps suggests that negative feedback gains of the 1st and 
the Nth vehicles are a consequence of the fact that both of 
them have access to their own global positions. 



As shown in Figs. 5a and 5b the normalized optimal gains 
for the formation without the fictitious follower also change 
continuously as £ increases to 1. In this case, however, the 
optimal forward and backward gains do not satisfy the central 



Since the underlying path-graph exhibits symmetry between 
the edge pairs associated with fn and ^at+i-u, the optimal for- 



symmetry; see Fig. |5c] Since the optimal controller puts more 
emphasis on the vehicles ahead when the fictitious follower 
is not present, the forward gains have larger magnitudes than 
the backward gains. As in the formations with the fictitious 
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(b) 

Fig. 4: Formation with fictitious follower, = 50, r = 1, 
Qo = T^, and Qd = I. (a) Normalized optimal forward 
gain f{£)/\\f{£)\\ changes from an almost sinusoidal shape 
(cf. analytical expression in (12)) at e = 10~^ to an almost 
piecewise linear shape at £ = 1. (b) Optimal forward (o) and 
backward (+) gains at £ = 1. 






(c) 

Fig. 5: Formation without fictitious follower, = 50, r = 1, 
Qo = T'^, and Qd = /. Normalized optimal (a) forward and 
(b) backward gains, (c) Optimal forward (o) and backward 
(+) gains at £ = 1. 



follower, the optimal forward gains decrease monotonically as 
one moves away from the fictitious leader. On the other hand, 
the optimal backward gains at first increase as one moves away 
from the 1st vehicle and then decrease as one approaches the 
Nth vehicle in order to satisfy the constraint = 0. 

V. Performance vs. size for the single-integrator 

MODEL 

In this section, we study the performance of the optimal 
symmetric and non-symmetric gains obtained in Sections llll| 



and IV-C This is done by examining the dependence on the 



formation size of performance measures 11^, 11/, and Ilctr 
introduced in Section |II-C| Our results highlight the role of 
non- symmetry and spatial variations on the scaling trends 
in large-scale formations. They also illustrate performance 



improvement achieved by the optimal controllers relative 
to spatially uniform symmetric and non- symmetric feedback 
gains. 

For the spatially uniform symmetric gain with = bn = 
a > 0, we show analytically that 11^ is an affine function of 
N. This implies that the formation coherence scales linearly 
with N irrespective of the value of a. We also analytically 
establish that the spatially uniform non-symmetric gain with 
{/n = <^ > 0. = 0} (look- ahead strategy) provides a 
square-root asymptotic dependence of 11^ on TV. Thus, sym- 
metry breaking between the forward and backward gains may 
improve coherence of large-scale formations. Note that the 
forward-backward asymmetry also provides more favorable 
scaling trends of the least damped mode of the closed-loop 
system 1 10|. We then investigate how spatially varying optimal 
feedback gains, introduced in Sections [nl| and [TV-Cl influence 
coherence of the formation. We show that the optimal sym- 
metric gain provides a square-root dependence of Ug on N 
and that the optimal non-symmetric gain provides sl fourth-root 
dependence of 11^ on A^. 

Even though we are primarily interested in asymptotic scal- 
ing of the global performance measure 11^, we also examine 
the local performance measure 11 ^ and the control energy 
Ilctr- From Section |II-C| we recall that the global and local 



performance measures quantify the formation- size-normalized 
I-L2 norm of the transfer function from d to Ci of the closed- 
loop system. 



X — 



c 



FCx 

Ci 

C2 



d 



FC 



X, Q g 



I. 
T, 



s = I, 



and that Ilctr is the formation- size-normalized I-L2 norm of the 
transfer function from d to (2- These can be determined from 

n, = (l/AT) trace (LQ,), 

Hctr = (1/A^) trace (L C^F^FC) , 

where L denotes the closed-loop controllability Gramian, 



(13) 



{-FC)L + L{-FCY 



L 



(14) 



The asymptotic scaling properties of Ug, 11/ , and Ilctr, for 
the above mentioned spatially uniform controllers and the spa- 



tially varying optimal controllers, obtained by solving |(SH2) 
with Q = I and r = 1, are summarized in Table [ll| For both 
spatially uniform symmetric and look-ahead strategies, we 
analytically determine the dependence of these performance 
measures on the formation size in Sections IV-AI and IV-BI 
Furthermore, for the formation without the fictitious follower 
subject to the optimal symmetric gains, we provide analytical 



results in Section V-C For the optimal symmetric and non- 
symmetric gains in the presence of fictitious followers, the 
scaling trends are obtained with the aid of numerical compu- 
tations in Section 

Several comments about the results in Table |Il| are given 
next. First, in contrast to the spatially uniform controllers, the 
optimal symmetric and non-symmetric gains, resulting from 



an A^-independent control penalty r in (SH2) do not provide 
uniform bounds on the control energy per vehicle, Ilctr- This 
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implies the trade-off between the formation coherence 11^ and 
control energy ITctr in the design of the optimal controllers. It 
is thus of interest to examine formation coherence for optimal 
controllers with bounded control energy per vehicle (see 
Remark[2]). Second, the controller structure (e.g., symmetric or 
non- symmetric gains) plays an important role in the formation 
coherence. In particular, departure from symmetry in localized 
feedback gains can significantly improve coherence of large- 
scale formations (see Remark [Sj. 

A. Spatially uniform symmetric gain 

For the spatially uniform symmetric controller with fn = 
6n = <^ > 0, we next show that 11 is an affine function of N 
and that, in the limit of an infinite number of vehicles, both 
11/ and Ilctr become formation- size-independent. These results 
hold irrespective of the presence of the fictitious follower. 

For the single-integrator model with the fictitious follower 
we have K = FC = aT (see ([5]) for the definition of T), 
and L = T~^/{2a) solves the Lyapunov equation (14) jsTl 
Lemma 1]. Since the nth diagonal entry of is determined 
by (cf. ^) 

(T-^)nn = n(7V + l-n)/(7V + l), 

from ([13]) we conclude that the global performance measure 
is an affine function of N, and that both 11/ and Ilctr are 
formation- size-independent. 



expression for e 



-aCft 



yielding the following formulae. 



= trace (T-^) /{2aN) 



1 ^ 

rvN ^ 



1 



AT 

E 



2olN ^ 2a7V(7V + l) ^ 12a 

n=l ^ ^n=l 

H/ = trace (TT-i) /(2a7V) = l/(2a), 
Hctr = trace (a^TTT-i) /(2a7V) = a. 

For the formation without the fictitious follower, the following 
expressions 



(7V+l)/(4a), H/ = 1/a, H^tr = a(37V+l)/(27V), 



imply that, for the spatially uniform symmetric controller, the 
asymptotic scaling trends do not depend on the presence of 
the fictitious follower (derivations omitted for brevity). 

B. Spatially uniform non-symmetric gain (look-ahead strat- 
egy) 

We next examine the asymptotic scaling of the performance 
measures for the spatially uniform non-symmetric gain with 
{/n = a > 0, 6n = 0}. We establish the square-root scaling 
of with N and the formation- size-independent scaling of 
11/ . Furthermore, in the limit of an infinite number of vehicles, 
we show that Ilctr becomes TV-independent. 

For the single-integrator model with K — FC = aCf (see 
([3]) for the definition of Cf), the solution of the Lyapunov 
equation P^ is given by 



L 



-aCft-aCi t 



dt 



(15) 



As shown in Appendix [B] the inverse Laplace transform 
of {si -\- aCf)~^ can be used to determine the analytical 



N 



N 



2ar(7V + 3/2) 



ar(n + 1/2) 
v^r(n) 



3v^r(Ar + l)' 
Ui = a, 
Hctr = a - {1/N)Lnn. 

with r(-) denoting the Gamma function. These are used in 
Appendix |B] to show that, in the limit of an infinite number of 
vehicles, a look-ahead strategy for the single-integrator model 
provides the square-root dependence of 11^ on N and the 
formation-size-independent 11/ and Ilctr- 

C. Optimal symmetric and non-symmetric controllers 

We next examine the asymptotic scaling of the performance 
measures for the optimal symmetric and non- symmetric gains 
of Sections |Illl and IIV-CI For the formation without the 
fictitious follower, we analytically establish that the optimal 
symmetric gains asymptotically provide 0(a/]V), 0{1/\^), 



and 0{VN) scalings of 11^, 11/, and Ilctr, respectively. We 
then use numerical computations to (i) confirm these scaling 
trends for the optimal symmetric gains in the presence of the 
fictitious follower; and to (ii) show a fourth-root dependence of 



and Ilctr on TV and an 0(1/ v TV) dependence of 11/ for the 
optimal non- symmetric gains. All these scalings are obtained 
by solving |(SH2)| with the formation- size-independent control 
penalty r and Q = I. We also demonstrate that uniform control 
variance (per vehicle) can be obtained by judicious selection 
of an TV-dependent r. For the optimal symmetric and non- 
symmetric gains, this constraint on control energy (variance) 
increases the asymptotic dependence of 11^ on TV to linear and 
square-root, respectively. 

For the formation without the fictitious follower, the op- 
timal symmetric gains are given by (|9]). As shown in ([TO]), 
trace {K~^) = trace {rK), thereby yielding 

^ trace {K'^) 

(16) 



In the limit of an infinite number of vehicles. 




lim 



TV 




which, for an TV-independent r, leads to an asymptotic square- 
root dependence of 11^ and Ilctr on TV, 



nctr(iv) 




, iV > 1 



, iV > 1. 



(17) 



Similar calculation can be used to obtain 0(1/ VN) asymp- 
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TABLE II: Asymptotic dependence of 11^, 11/, and Ilctr on the formation size N for uniform symmetric, uniform non- symmetric 
(look-ahead strategy), and optimal symmetric and non-symmetric gains of Sections III and IV-C with Q = I and r = 1. The 
scalings displayed in red are determined analytically, other scalings are estimated based on numerical computations. 



Controller 


n 


a 


Hi 


Ifctr 


uniform symmetric with/without follower 


OiN) 


0(1) 


0(1) 


uniform non-symmetric 


0(v 


^) 


0(1) 


0(1) 


optimal symmetric without follower 


0(v 


^) 


0{i/Vn) 


0{Vn) 


optimal symmetric with follower 


0(v 


^) 


0{i/Vn) 


0{Vn) 


optimal non-symmetric with/without follower 




^) 


0{l/</N) 





N 
(a) 




(b) 




0.56 
0.54 
0.52 
0.5 
0.48 
0.46 
0.44 



100 

N 



(b) 



Fig. 6: (a) Square-root scaling of Ug (*) using optimal sym- Fig. 7: (a) 11/ (*) using the optimal symmetric gain of Sec 



metric gain of Section |lll| 0.27847^" + 0.0375 (curve); and tion[lIl| 1.8570/VA^+0.0042 (curve); a nd (b) Uj (o) using the 
(b) Fourth-root scaling_of 11^ (o) using optimal non-symmetric optimal non-symmetric gain of Section IV-C 1.4738/ + 
gain of Section 



IV-C 



0.4459a 



- 0. 0866 (c urve). The 
optimal controllers are obtained by solving |(SH2)| with Q = I 
and r = 1 for the formation with the fictitious follower. 



optimal non-symmetric gain of Section 
0.0191 (curve). The optimal controllers are obtained by solv- 
/ and r 



ing |(SH2)| with Q 
fictitious follower. 



1 for the formation with the 



totic scaling of 11/. 

We next use numerical computations to study the scaling 
trends for the optimal symmetric and non-symmetric gains in 
the presence of fictitious followers. The optimal symmetric 
gain (cf. (o) in Fi g. [3] ) provides a square-root scaling of Ug 
with N; see Fig. [6a On the other hand, the optimal non- 



symmetric gain (cf. Fig. 4b) leads to sl fourth- root scaling of 



with N; see Fig. [6b] The local performance measure 11/ 
decreases monotonically with N for both controllers, with 11/ 
scaling as 0(l/\/]V) for the optimal symmetric gain and as 
0(1/ v^) for the optimal non-symmetric gain; see Fig.]?] For 
both the optimal symmetric and non-symmetric controllers, 
our computations indicate equivalence between the control 
energy and the global performance measure when r = 1. (For 
the optimal symmetric gain without the fictitious follower and 
r = 1, we have analytically shown that Ilctr = n^; see for- 
mula ( 16 ).) Therefore, the asymptotic scaling of the formation- 
size-normalized control energy is 0{-\fN) for the optimal 
symmetric gain and O^^fN) for the optimal non-symmetric 
gain. Finally, for the formations without the fictitious follower, 
our computations indicate that the optimal non- symmetric 
gains also asymptotically provide 0{\fN), 0(1/ v^), and 



0{yN) scalings of 11^, E/, and Ilctr, respectively. 

Remark 2: In contrast to the spatially uniform controllers, 
the optimal structured controllers of Sections [lll| and [TV-C} re- 



sulting from an A/^-independent control penalty r in |(SH2)| do 
not provide uniform bounds on the formation- size-normalized 



control energy. These controllers are obtained using I-L2 frame- 
work in which control effort represents a 'soft constraint'. 
It is thus of interest to examine formation coherence for 
optimal controllers with bounded control energy per vehicle. 
For formations without the fictitious follower, from ^Vl\ we 
see that the optimal symmetric controller with r{N) = 2N/9 
asymptotically yields Hctr ~ 1 and Ug ^ 2N/9 + l/(3\/2). 
Similarly, for formations with followers, the optimal gains that 
result in Ilctr ^ 1 for large N can be obtained by changing 
control penalty from r = 1 to r(7V) = 0.08 A/" for the optimal 
symmetric gain and to r{N) = 0.175\/]V for the optimal non- 
symmetric gaii|^ These TV-dependent control penalties provide 
an affine scaling of 11^ with N for the optimal symmetric 
gain and a square -root scaling of 11^ with N for the optimal 
non-symmetric gain; see Fig. [8] The asymptotic scalings for 
formations without followers subject to the optimal symmetric 
gains are obtained analytically (cf. ([TT])); all other scalings are 
obtained with the aid of computations. 

Remark 3: Figure [8] illustrates the global performance mea- 
sure obtained with four aforementioned structured con- 
trollers that asymptotically yield Ilctr ^ 1 for formations with 
fictitious follower. Note that the simple look-ahead strategy 
outperforms the optimal symmetric gain; 0{^/N) vs. 0{N) 
scaling. Thus, departure from symmetry in localized feedback 
gains can significantly improve coherence of large-scale for- 

^Both spatially uniform symmetric and look-ahead strategies with a = 1 
yield Ilctr = 1 in the limit of an infinite number of vehicles. 
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Fig. 8: using four structured gains with Ilctr ^ 1 for 
formations with fictitious follower: spatially uniform sym- 
metric (o), N/12 + 1/6 (blue curve), spatially uniform non- 
symmetric (<), 2>/]V/(3v^) (green curve), optimal symmet- 
ric (*), 0.07937V + 0.0493 (black curve), and optimal non- 
symmetric (o), 0.1807V7V - 0.0556 (red curve). 



mations. In particular, we have provided an example of a 
spatially uniform non- symmetric controller that yields better 
scaling trends than the optimal spatially varying controller 
obtained by restricting design to symmetric gains. Given the 
extra degrees of freedom in the optimal symmetric gain this is 
perhaps a surprising observation, indicating that the network 
topology may play a more important role than the optimal 
selection of the feedback gains in performance of large-scale 
interconnected systems. On the other hand, our results show 
that the optimal localized controller that achieves the best 
performance is both non-symmetric and spatially -varying. 



VI. Double-integrator model 



In this section, we solve |(SH2)| for the double-integrator 
model using the homotopy -based Newton's method. We then 
discuss the influence of the optimal structured gain on the 
asymptotic scaling of the performance measures introduced 
in Section III-CI For a formation in which each vehicle - in 
addition to relative positions with respect to its immediate 
neighbors - has access to its own velocity, our results highlight 
similarity between optimal forward and backward position 
gains for the single- and the double-integrator models. We 
further show that the performance measures exhibit similar 
scaling properties to those found in single-integrators. We also 



establish convexity of (SH2) for the double-integrator model 
by restricting the controller to symmetric position and uniform 
diagonal velocity gains. 

The perturbation analysis and the homotopy-based New- 
ton's method closely follow the procedure described in 
Sections |IV-B| and IV-C respectively. In particular, Fq = 
[al al 131] yields Kq = FqC = [aT 131]. As shown 
in jssj, for positive a and (3 with > 8a, this spatially 
uniform structured feedback gain is stabilizing and inversely 




10 20 



10 20 



(a) 



(b) 



Fig. 9: Double-integrator model with fictitious follower, N = 
50, Q = / and r = 1. (a) The optimal forward (o) and 
backward gains (+); (b) the optimal velocity gains (o). 



optimal with respect to 

n - \ Qp O 
- [ O 



r(/32/-2aT), r > 0. 
In what follows, we choose a = 1 and /3 = 3 and employ 



the homotopy-based Newton's method to solve |(SH2)| for 
the double-integrator model. For a formation with fictitious 
follower, N = bO, Q = I, and r = 1 the optimal forward and 
backward position gains are shown in Fig. l9a| and the optimal 



velocity gains are shown in Fig. 9b We note remarkable 
similarity between the optimal position gains for the single- 



and the double-integrator models; cf. Fig. 9a and Fig. 4b For 
a formation without fictitious follower, the close resemblance 
between the optimal position gains for both models is also 
observed. 

As in the single-integrator model, our computations indicate 



that the optimal localized controller, obtained by solving (SH2) 
with Q = I and r = 1, provides a fourth-root dependence 
of the macroscopic performance measure 11^ on N; see 



Fig. 10a Furthermore, the microscopic performance measure 
and control energy asymptoti cally scale as 0(1 / -^N) and 



10b 



and Fig. 



10c 



0{yN), respectively; see Fig. 

For comparison, we next provide the scaling trends of 
the performance measures for both the spatially uniform 
symmetric and look-ahead controllers. As in the single- 
integrator model, the spatially uniform symmetric gain Fq = 
[ al al j3I ] provides linear scaling of 11^ with N and the 
formation-size-independent 11^ and Ilctr, 

n,(7V) = (AT + 2)/(12a/3) + 1/(2/3), 
= l/(2ap) + 1/(2/3), 

Hctr = a/P + /3/2. 

On the other hand, for the double-integrator model the perfor- 
mance of the look-ahead strategy K = FC = [aCf /3I] 
heavily depends on the choices of a and /3. In particular, 
for a = 1/4 and /3 = 1, using similar techniques as in 
Section \V-B\ we obtain 



n,(iv) 



i)+r(2»-?)). 



2Nr{2n) 

which asymptotically leads to the formation-size-independent 
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0.75p 
0.74 
0.73 
0.72 
0.71 
0.7 
0.69- 



N 

(a) 





(C) Hctr 

Fig. 10: Double-integrator model with the optimal non- 
symmetric gain obtained by solving (SH2) with Q = I and 
r = 1 for formations with the fictitious follower: (a) (o), 
0.0736v^ + 0.4900 (curve) (b) Ui (o), 1.1793/v^ + 0.0408 
(curve); (c) Hctr (o), 0.2742 + 0.8830 (curve). 



scaling of Ilctr and the square-root scaling of 11^ with N, i.e., 
lim n^(7V)/V^ = 16/(3V27r). This is in sharp contrast to 
a = P = 1 which leads to an exponential dependence of lig 
on N. Therefore, the design of the look- ahead strategy is much 
more subtle for double-integrators than for single-integrators. 

Remark 4: For the double-integrator model with K = 
F C = \K ^ pi] and fixed /3 > we next show convexity 
of (SH2) with respect to Kp = K'F > 0. The Lyapunov 



equation in (SH2) for the block diagonal state weight Q 



with components Qi and Q2, can be rewritten in terms of 

P2 



the components of P 



KpPj 



KpP2 



Pi 



PoKp 
+ PPo 
WP2 



= Qi + 
= PKp, 
= Po + 



KpKp^ 



^0 



Q2 



(18a) 
(18b) 
(18c) 



Linearity of t he t race operator in conjunction with Bi = 
[O 7]^ and |T8c|) yields 



J 



trace (P2) = trace (2Po + Q2 + P^l) /{2f3) 
= trace (i^-iQi+i^p + g2+/3'/)/(2/3), 

where the last equation is obtained by multiplying ( |18a| ) from 
the left with and using trace {K~^PoKp) = trace (Pq). 
For Qi > 0, similar argument as in Section |lll| can be used to 
conclude convexity of J with respect to Kp = > 0. 



in which local information exchange of relative positions 
between immediate neighbors imposes structural constraints 
on the feedback gains. We study the design problem for both 
the single- and the double-integrator models and employ a 
homotopy-based Newton's method to compute the optimal 
structured gains. We also show that design of symmetric 
gains for the single-integrator model is a convex optimization 
problem, which we solve analytically for formations with no 
fictitious followers. For double-integrators, we identify a class 
of convex problems by restricting the controller to symmetric 
position and uniform diagonal velocity gains. Furthermore, 
we investigate the performance of the optimal controllers by 
examining the asymptotic scalings of formation coherence and 
control energy with the number of vehicles. 

For formations in which all vehicles have access to their 
own velocities, the optimal structured position gains for single- 
and double-integrators are similar to each other. Since these 
two models exhibit the same asymptotic scalings of global, 
local, and control performance measures, we conclude that 
the single-integrator model, which lends itself more easily 
to analysis and design, captures the essential features of the 
optimal localized design. We note that the tools developed 
in this paper can also be used to design optimal structured 
controllers for double-integrators with relative position and 
velocity measurements; this is a topic of our ongoing research. 

As in 1 10], we employ perturbation analysis to determine 
the departure from a stabilizing spatially uniform profile 
that yields nominal diffusion dynamics on a one-dimensional 
lattice; in contrast to |10|, we find the 'mistuning' profile 
by optimizing a performance index rather than by perform- 
ing spectral analysis. We also show how a homotopy-based 
Newton's method can be employed to obtain non-infinitesimal 
variation in feedback gains that minimizes the desired objec- 
tive function. Furthermore, we establish several explicit scaling 
relationships and identify a spatially uniform non- symmetric 
controller that performs better than the optimal symmetric 
spatially varying controller (0{^/N) vs. 0{N) scaling of 
coherence with 0(1) control energy per vehicle). This suggests 
that departure from symmetry can improve coherence of large- 
scale formations and that the controller structure may play a 
more important role than the optimal feedback gain design. 
On the other hand, our results demonstrate that the best 
performance is achieved with the optimal localized controller 
that is both non-symmetric and spatially- varying. 

Currently, we are considering the structured feedback design 
for formations on general graphs |[6|, |[8|, | [23| , p6| , p7| with 
the objective of identifying topologies that lead to favorable 
system-theoretic properties [28] |, p8| , f39J . Even though this 
paper focuses on the optimal local feedback design for one- 
dimensional formations with path-graph topology, the devel- 
oped methods can be applied to multi-agent problems with 
more general network topologies. 



VII. Concluding remarks 

We consider the optimal control of one-dimensional for- 
mations with nearest neighbor interactions between the ve- 
hicles. We formulate a structured optimal control problem 



Acknowledgements 

The authors would like to thank anonymous reviewers and 
the associate editor for their valuable comments. 



14 



Appendix 



A. Gradient method for (SG) 



We next describe the gradient method for solving |(SG)[ Let 
us denote k = [ki • • • k^+i ]^ • Starting with an initial guess 
k^ that guarantees positive definiteness of K^, vector k is 
updated = /c* — s^VJ{k'^)^ until the norm of gradient 
is small enough, ||VJ(/c*)|| < e. Here, is the step-size 
determined by the backtracking line search |[32| Section 9.2]: 
let 5* = 1 and repeat := I3s^ with ^ G (0, 1) until a 
sufficient decrease in the objective function is achieved, 

J{k' - s'VJ{k')) < J{k') - as'\\\/J{k')f, 

where a G (0, 0.5). Note that J(/c*) is defined as infinity if K 
in ^ determined by /c* is not positive definite. For Q = I, 

^ trace (i^"^ ^rK) 



J 



1 ^ 

IE 



7n(7. 



'AT+l 



7n) 



n = 2 / 



the entries of the gradient V J are given by 

-1 



7i 



1^ 



7iv+i 



2 V /Cn7Ar+ 



5j 

dki 

dJ 
dkN+i 



ne{2,...,N} 

N 



1 / 7jV+l - 7ri 



^Ar+i7A^+i 



5. Performance of look-ahead strategy 

We next derive the analytical expressions for the perfor- 
mance measures 11^, 11^, and Ilctr obtained with the look- 
ahead strategy for the single-integrator model. The solution of 
the Lyapunov equation ([14]) with FC = aCf is determined 
by ( p?) . Since the ith entry of the first column of the lower 
triangular Toeplitz matrix {si + aCf)~^ is a'^/{s -\- a)\ the 
corresponding entry of the matrix exponential in ([15]) is 
determined by the inverse Laplace transform of a'^/{s -\- a)\ 



Thus, the nth element on the main diagonal of the matrix L 
in ( [TS] ) is given by 

/ — ^ / . ( n/t )" " ^ ^ 

(19) 



ar(n + l/2) _ a{2n)\ 



V^r(n) 22^(n-l) 



I 77 ,1' 



thereby yielding 

N 



Lnn 2ar(7V + 3/2) 2 a{2N^2)\ 



TV 3v^r(7V + l) 3 22^+2Ar!(7V + i)!- 

(20) 



A similar procedure can be used to show that the n(n + l)th 
entry of L is determined 



1,...,7V-1. (21) 



(n+l)(n+l) - (^/2, n 

Now, from (21 ) and the fact that Lii=a/2we obtain 

1 2 f ^ 

Hz = — trace (TL) = ^ 

\n = 1 

Similarly, 



N-l 



^n(n+l) = 



n = 1 



Hctr = (1/A^) trace (lC7JC7/) 



N 



N-l 



N 

= a - 



= 1 n = 1 

(1/7V) 



+1) 



N 



Using Stirling's approximation n! 
n, we have 



/27rn (n/e)^ for large 



1 • Ljiji 

n^oo Jn 



lim 



n-l 



where we used the fact that lim (n/(n — 1))^ = e. Con- 

n ^ CO 

sequently, lim Ilctr (^) = ol- From ([19]) and (20), it follows 

N ^ oo I I I I 

that = (2/3)L(Ar+i)(Ar+i) and thus, lim Ug{N)/VN = 

N ^ oo 

(2a)/(3>/7r)- We conclude that 11^; asymptotically scales as 
a square-root function of N and that Ilctr is formation- size- 
independent as N increases to infinity. 
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